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Abstract 

If A is an n x n matrix whose n eigenvalues are ordered in terms of decreasing 
modules, |Ai| > IA2I > • • • |A n |, it is often of interest to estimate 1^4. If A is a row 
stochastic matrix (so Ai = 1), one can use an old formula of R. L. Dobrushin to give 
a useful, explicit formula for | A2 [ . The purpose of this note is to disseminate these 
known results more widely and to show how they imply, as a very special case, some 
recent theorems of Haveliwala and Kamvar about the second eigenvalue of the Google 
matrix. 

If A = (ciij) is an n x n real matrix, A has n (counting algebraic multiplicity) complex 
eigenvalues which can be listed in order of decreasing modules: |Ai| > \\%\ > ■•• > |A n |. 
We have |Ai| = sup{|A||A is an eigenvalue of A} and |Ai| is called the spectral radius of 
A,r(A) := |Ai|. In many problems it is of interest to estimate j^j = Indeed, an 

analogous problem is of great interest for bounded linear maps on Banach spaces: see [2], 
[3] and the references there. 

Slightly more generally, suppose that V is an m-dimensional real vector space and L : 
V — > V is a linear map. Again L has m possibly complex eigenvalues which can be written 
in order of decreasing modules: |Ai| > | A2 1 > • ■ ■ > |A m |. If || • || denotes any norm on V 
(recall that all norms on a finite dimensional real vector space give the same topology), we 
can define 

\\L\\=sup{\\Ly\\:yeV,\\y\\<l}. (1) 

It is known that 

r(L) = |Ai| = sup{|A| : A is an eigenvalue of L} (2) 



lim ||L fc || k = inf \\L ku ' 

k— >oo fe>l 



where L k denotes the composition of L with itself fc-times. 
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We shall consider elements of M. n , as usual, as column vectors. An nxn matrix B induces 
a linear map A : IR n — > IR n by A(y) = By. If V is a vector subspace of R™ and By G V 
for all y G V, then B induces a linear map L : V — > V by = -By for y E V . If 

dim(V) = to, then L has (counting algebraic multiplicity) precisely m eigenvalues, and these 
are the eigenvalues of B whose corresponding eigenvectors lie in the complexification of V . 

Now suppose that A = (a^) is an n x n row stochastic matrix, so > for all i,j and 
Sj=i a y = 1 f° r 1 — * — n - Denote by x* the transpose of a vector x and by 5* the transpose 
of a matrix B. If e = (1, 1, • • • , 1)*, then Ae = e, so 1 G c(^4), where cr(A), the spectrum 
of ^4, denotes the collection of eigenvalues of A. Recall that (in general) cr(A) = o~{A t )^ so 
1 G cr(A*). It follows that (in general) r(A) = r(A t ); and it is an elementary fact (the proof 
is sketched below) that r(A) = 1 for A row stochastic. 

It will be convenient to use the L 1 norm II • II, on W\ so for 



y = (2/i,2/2,- •• ,y n ye^ n (3) 



\y\h 



Using the L 1 norm, we get a corresponding norm on n x n matrices B = (6^), since these 
matrices induce linear maps: 

11^11! = sup{||Sj/|| 1 : Hs/Hi < 1,2/eR"}. (4) 

Indeed, using this norm when A is row stochastic, it is easy to see that ||A*||i = 1. Since 
1 G cr{A t ), we deduce, using eq. (2), that r(A t ) = 1 and hence r(A) = 1. 

n 

Ux,yE R n , let (x,y) = ^x iyi . 

i=i 

Lemma 1 Lei A be an n x n row stochastic matrix and let V — {x — (x±,X2, • • • , x„)' G 
R"| = 0}. Ifx G V, it follows that A l x G V. 

Proof: If rr G V, (x, e) = = (x, Ae) = (A'x, e), so A*x G V. ■ 
Henceforth, V will be as in Lemma 1. 

If A is row stochastic, let L : V — > V be the linear map induced by A*. If 1 = Ai > 
| As | > ■ ■ • > |A ra | are the moduli of the eigenvalues of A 1 , our previous remarks show that 
A2, A3, • • • , A n are the eigenvalues of L and eq. (2) implies that 

|A 2 | := spectral radius of L := r(L) = lim \\L k \\£ = inf \\L k \\± . (5) 

k^oo k>l 



By definition, 



|L fc ||! = s U p{||(A fe )* 2/ || 1 : J/ € ^, < 1} (6) 
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Note that A k is a row stochastic matrix. If B is any row stochastic matrix, we follow (6) 
and define 



q(B) = sup{||EVl|i:ye^lMli<l}, where (7) 

n 

V = {j, G M n : J> = 0}. 

1 

The formula given by eqns (5)- (7) would be of limited usefulness without an explicit formula 
for q(B). Fortunately, Dobrushin has given such a formula in Lemma 1, Section 3 of [1]; a 
slightly more general result is proved in Lemma 3.4 of [5]. 

Lemma 2 (Dobrushin [1]). Let B = (6^) be an n x n row stochastic matrix and let V = 
{y E W n \ YJlVi = 0}. Ifq(B) is defined by (7), then 



l( B ) = [\ ) sup ( 1% - M ) = 1 ~ mi fe n mm ( 6 *i> h kj)- 
\ J i,k \ j=1 J l < j=1 



(8) 



Combining the above observations we obtain a useful formula for \X 2 \ when A is row 
stochastic. 

Theorem 1 Let A be an n x n row stochastic matrix with eigenvalues 1 = Ai, A2, • • • , \ n , 
where 1 = |Ai| > | A2 1 > ••• > |A„| and eigenvalues are counted with algebraic multiplicity. 
(Recall that these eigenvalues are the same as the eigenvalues of A 1 ). Then we have 

|A 2 | = \imq{A k )^ = miq(A k )^, (9) 

fc^oo k>l 

where q(B) is defined by eq. (8) 

One can verify directly that for any n x n real matrix B, if we define q(B) := (|) sup 

(j2 T j=i — bkj\j, then q is a seminorm, ie, q(B + C) < q{B) + q(C) for any n x n matrices 

B and C and q(aB) = \a\q(B) for any scalar a. Furthermore, if B and C are any nx n real 
matrices which have e* = (1, 1, • • • , 1)* as an eigenvector, then q(BC) < q(B)q(C). 

For the case that E is row stochastic of rank 1, the next result is proved in [4] by different 
methods. 

Corollary 1 Let P be an n x n row stochastic matrix and let E be an n x n row stochastic 
matrix. If < c < 1, let A — cP + (1 — c)E and let A 2 denote the second eigenvalue of A 
(where 1 = Ai > |A 2 | > |A 3 | > • • • > |A n |/ Then we have 



|A 2 | < cq(P) + (1 - c)q(E) and |A 2 | < c if E has rank I. (10) 

Proof: Theorem 1 implies that |A 2 | < q(A) < cq(P) + (1 — c)q(E). If E has rank 1, then all 
rows of E are identical and q(E) = 0. Since q(P) < 1, this gives q(A) < c when E has rank 
1. - 

The following result is proved in [4] by a somewhat more involved argument. 
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Corollary 2 Let P and E be as in Corollary 1 and assume E has rank 1. If {y G M n \y = 
Py} has dimension greater than one then |A 2 | = c, where A 2 is the second eigenvalue of 
cP + (1 — c)E. In fact, we have A 2 = c. 

Proof: By assumption, there are linearly independent vectors v and w with Pv = v and 
Pw = w. We also know there is a vector z G M n , ^™ =1 = 1, ^ > for 1 < % < n, such 
that Ex = (x, z)e. If (v, z) = 0, (cP + (1 - c)E)v = cPv = cv, and if (w, z) = 0, (cP + (1 - 
c)E)w = cw. Thus assume that (v, z) ^ and (w, 7^ and define ^ = —(w, z)v + (f , 
Note that (£,z) = and £ 7^ because u and to are linearly independent. It follows that 
(cP + (1 — c)P)£ = cP^ = d;. We conclude that c is an eigenvalue of cP + (1 — c)E. Since 
we already know from Corollary 1 that |A 2 | < c we conclude that |A 2 | = c and that we can 
take A 2 = c. ■ 

Remark 1 The statement (see [4]) that "P has at least two irreducible closed subsets" is 
equivalent to the assertion that dim{?/ G M. n \y = Py} > 2. 

Remark 2 Suppose that A is row stochastic and q{A) — k < 1. Let ^ = {x G M. n \ = 
1 and Xj > for 1 < j < n}. One easily checks that A l x G ^ if x G ^2, and our previous 
remarks show that \\A t x — A t y\\ 1 < k\\x — y\\ \ for all x, y G J^. By the contraction mapping 
theorem, for any 16^, lim = v, where A l v = v. Also, the rate of convergence can 

be estimated in terms of k. The same assertions are true if q(A m ) = K m < 1 for some m > 1. 
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